[Anesthesiology Journal club assessment by means of semantic changes]. / Avaliação do clube de revista de anestesiologia por meio de mudanças semânticas.

BACKGROUND AND OBJECTIVES: The interactive approach of a journal club has been described in the medical education literature. The aim of this investigation is to present an assessment of journal club as a tool to address the question whether residents read more and critically. METHODS: This study reports the performance of medical residents in anesthesiology from the Clinics Hospital - University of São Paulo Medical School. All medical residents were invited to answer five questions derived from discussed papers. The answer sheet consisted of an affirmative statement with a Likert type scale (totally disagree-disagree-not sure-agree-totally agree), each related to one of the chosen articles. The results were evaluated by means of item analysis - difficulty index and discrimination power. RESULTS: Residents filled one hundred and seventy three evaluations in the months of December 2011 (n=51), July 2012 (n=66) and December 2012 (n=56). The first exam presented all items with straight statement, second and third exams presented mixed items. Separating "totally agree" from "agree" increased the difficulty indices, but did not improve the discrimination power. CONCLUSIONS: The use of a journal club assessment with straight and inverted statements and by means of five points scale for agreement has been shown to increase its item difficulty and discrimination power. This may reflect involvement either with the reading or the discussion during the journal meeting.

Anesthesiology Journal club assessment by means of semantic changes.

BACKGROUND AND OBJECTIVES: the interactive approach of a journal club has been described in the medical education literature. The aim of this investigation is to present an assessment of journal club as a tool to address the question whether residents read more and critically. METHODS: this study reports the performance of medical residents in anesthesiology from the Clinics Hospital - University of São Paulo Medical School. All medical residents were invited to answer five questions derived from discussed papers. The answer sheet consisted of an affirmative statement with a Likert type scale (totally disagree-disagree-not sure-agree-totally agree), each related to one of the chosen articles. The results were evaluated by means of item analysis - difficulty index and discrimination power. RESULTS: residents filled one hundred and seventy three evaluations in the months of December 2011 (n=51), July 2012 (n=66) and December 2012 (n=56). The first exam presented all items with straight statement, second and third exams presented mixed items. Separating "totally agree" from "agree" increased the difficulty indices, but did not improve the discrimination power. CONCLUSIONS: the use of a journal club assessment with straight and inverted statements and by means of five points scale for agreement has been shown to increase its item difficulty and discrimination power. This may reflect involvement either with the reading or the discussion during the journal meeting.

Anesthesiology Journal club assessment by means of semantic changes / Avaliação do clube de revista de anestesiologia por meio de mudanças semânticas / Evaluación del club de la revista de anestesiología por medio de cambios semánticos

BACKGROUND AND OBJECTIVES: the interactive approach of a journal club has been described in the medical education literature. The aim of this investigation is to present an assessment of journal club as a tool to address the question whether residents read more and critically. METHODS: this study reports the performance of medical residents in anesthesiology from the Clinics Hospital - University of São Paulo Medical School. All medical residents were invited to answer five questions derived from discussed papers. The answer sheet consisted of an affirmative statement with a Likert type scale (totally disagree-disagree-not sure-agree-totally agree), each related to one of the chosen articles. The results were evaluated by means of item analysis - difficulty index and discrimination power. RESULTS: residents filled one hundred and seventy three evaluations in the months of December 2011 (n = 51), July 2012 (n = 66) and December 2012 (n = 56). The first exam presented all items with straight statement, second and third exams presented mixed items. Separating "totally agree" from "agree" increased the difficulty indices, but did not improve the discrimination power. CONCLUSIONS: the use of a journal club assessment with straight and inverted statements and by means of five points scale for agreement has been shown to increase its item difficulty and discrimination power. This may reflect involvement either with the reading or the discussion during the journal meeting. .

JUSTIFICATIVA E OBJETIVOS: a abordagem interativa de um clube de revista foi descrita na literatura de ensino médico. O objetivo desta investigação é apresentar uma avaliação do clube de revista como uma ferramenta para discutir a questão da leitura crítica entre os residentes. MÉTODOS: este estudo relata o desempenho dos médicos residentes de anestesiologia do Hospital das Clínicas - Faculdade de Medicina da Universidade de São Paulo. Todos os médicos residentes foram convidados a responder a cinco perguntas derivadas de artigos discutidos. A folha de resposta consistia em uma declaração afirmativa com uma escala do tipo Likert (discordo totalmente, discordo, não tenho certeza, concordo, concordo totalmente), cada declaração relacionada a um dos artigos escolhidos. Os resultados foram avaliados por meio da análise de itens - índice de dificuldade e poder de discriminação. RESULTADOS: os residentes completaram 173 avaliações nos meses de dezembro de 2011 (n = 51), julho de 2012 (n = 66) e dezembro de 2012 (n = 56). O primeiro teste apresentou todos os itens com declaração direta e o segundo e terceiro testes apresentaram itens mistos. Separar "concordo totalmente" de "concordo" aumentou os índices de dificuldade, mas não melhorou o poder de discriminação. CONCLUSÕES: o uso de uma avaliação do clube revista com declarações diretas e inversas e com o uso de uma escala de cinco pontos para acordo mostrou aumentar a dificuldade do item e o poder de discriminação. Isso pode refletir o envolvimento com a leitura ou com a discussão durante as reuniões do clube. .

JUSTIFICACIÓN Y OBJETIVOS: El abordaje interactivo de un club de revista ha sido descrito en la literatura de enseñanza médica. El objetivo de esta investigación es presentar una evaluación del club de revista como una herramienta para discutir la cuestión de la lectura crítica entre los residentes. MÉTODOS: Este estudio relata el desempeño de los médicos residentes de anestesiología del Hospital das Clínicas de la Facultad de Medicina de la Universidad de São Paulo. Todos los médicos residentes fueron invitados a responder a 5 preguntas derivadas de artículos discutidos. La hoja de respuesta consistía en una declaración afirmativa con una escala del tipo Likert ("estoy totalmente en desacuerdo", "en desacuerdo", "no estoy seguro", "estoy de acuerdo", "estoy totalmente de acuerdo"), cada declaración relacionada con uno de los artículos escogidos. Los resultados se evaluaron por medio del análisis de los ítems: índice de dificultad y poder de discriminación. RESULTADOS: Los residentes completaron 173 evaluaciones en los meses de diciembre de 2011 (n = 51), julio de 2012 (n = 66) y diciembre de 2012 (n = 56). El primer test incluyó todos los títulos con declaración directa y el segundo y el tercero tuvieron títulos mezclados. Separar "estoy totalmente de acuerdo" de "estoy de acuerdo" aumentó los índices de dificultad pero no mejoró el poder de discriminación. CONCLUSIONES: El uso de una evaluación del club de revista con declaraciones directas e inversas y con el uso de una escala de 5 puntos para "estoy de acuerdo", mostró el aumento de la dificultad del ítem y del poder de discriminación. Eso puede reflejar el nivel de implicación en la lectura o en la discusión durante las reuniones del club. .